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INTRODUCTION 

The  goals  of  this  paper  are  Chose  of  Its  predecessor  [2]:  Co 
solve  staircase-structured  linear  programs  faster  through  adaptation  of 
the  algorithms  of  the  modern  simplex  method.  The  means  are  quite  different, 
however.  Whereas  [2]  concentrated  on  "Inversion"  algorithms  that  factorize 
the  basis  and  solve  linear  systems,  the  present  paper  looks  at  "pricing" 
algorithms  that  find  a  variable  to  enter  the  basis  at  each  iteration. 

Pricing  involves  two  sorts  of  activities:  confutation  of  reduced 
costs  that  determine  which  variables  are  eligible  to  enter  the  basis,  and 
selection  of  an  entering  variable  from  among  those  eligible.  Thus  an 
implementation  of  pricing  in  the  simplex  method  requires  both  computation 
and  selection  algorithms.  Either  sort  of  algorithm  may  be  adapted  to 
staircase  structure. 

This  paper  begins  with  a  short  general  review  of  staircase  linear 
programs.  Sections  2  and  3  then  look  at  the  computation  algorithms,  after 
which  Sections  A  and  5  deal  with  selection  algorithms.  Staircase  adapta¬ 
tions  of  both  kinds  of  algorithms  are  proposed  and  evaluated. 

Section  6  reports  extensive  computational  experience  with  the  pre¬ 
ceding  proposals.  The  staircase  computation  algorithms  for  pricing  are 
found  to  offer  modest  but  consistent  savings.  Staircase  selection 
algorithms,  properly  chosen,  produce  more  spectacular  results:  the  number 
of  iterations,  time  per  iteration,  or  both  may  be  reduced  substantially 
by  comparison  with  standard  methods. 

Overall  the  prospects  for  staircase  adaptation  of  the  simplex 
method  appear  highly  promising.  When  the  methods  of  this  paper  are  com¬ 
bined  with  those  of  [2]  in  the  most  efficient  way,  one  may  expect  savings 
of  50%  or  more  for  many  different  kinds  of  staircase  linear  programs. 


1.  STAIRCASE  LINEAR  PROGRAMS 

This  section  summarizes  the  treatment  of  staircase  structures 
developed  in  [1,2],  with  special  attention  to  properties  important  in 
pricing. 

Formulation 

Staircase  linear  programs  (LPs),  as  defined  in  [2],  share  two 
simple  characteristics:  their  variables  fall  into  some  sequence  of  dis¬ 
joint  groups;  and  their  constraints  relate  only  variables  within  adjacent 
groups.  Usually  the  sequence  of  groups  corresponds  to  a  sequence  of 
times,  so  that  variables  in  a  group  are  said  to  represent  activities  of 
one  period .  Constraints  thus  indicate  how  activities  in  one  period  are 
related  to  activities  in  the  next. 

A  constraint  is  said  to  be  in  period  l  if  it  contains  variables  of 
period  t  but  not  of  later  periods.  Typically  some  constraints  involve 
only  variables  of  period  l,  while  others  relate  variables  of  periods  d 
and  d-1;  the  latter  are  linking  constraints,  whereas  the  former  are  non- 
linking  .  Analogously,  linking  variables  appear  in  constraints  of  periods  d 
and  d+1,  while  non-linking  variables  appear  only  in  constraints  of 
period  d . 

A  more  general  approach  defines  a  staircase  LP  to  be  of  order  r 
if  its  constraints  relate  variables  that  are  at  most  r  periods  apart. 

Many  of  the  ideas  of  this  paper  are  applicable  to  staircase  LPs  of  any 
order.  However,  the  emphasis  is  on  first-order  staircases  as  defined  above: 
these  have  the  simplest  and  strongest  structure,  and  so  are  best  suited 
to  special  techniques. 
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Staircase  matrices 


* 


Following  [2],  the  matrix  of  constraint  coefficients  of  a  staircase 
linear  program  is  a  staircase  matrix.  Its  nonzero  elements  are  confined 
to  certain  submatrices  centered  roughly  on  and  just  off  the  diagonal — as, 
for  example. 
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Formally,  one  partitions  the  rows  of  an  m  *  n  matrix  A  into  t  disjoint 

subsets,  and  the  columns  into  t  disjoint  subsets,  so  that  A  is 
2 

partitioned  into  t  submatrices,  or  "blocks": 


Aij  i  -  1, . .  .,t;  j  -  1, . .  .,t 

A  is  lower  staircase  (as  above)  if  A^  -  0  except  for  i  -  j  and 
i  -  j+1.  A  is  upper  staircase  if  A^  -  0  except  for  i  -  j  and 
i  -  j-1. 

By  analogy  with  staircase  LPs,  rows  in  the  ith  partition  of  a 
staircase  matrix  A  are  called  perlod-i  rows,  and  columns  in  the  jth 
partition  are  called  period-j  columns.  If  a  period-i  row  has  nonzero 
elements  in  blocks  A^^  and  A  ,  it  is  a  linking  row;  if  it  has 
nonzeroes  only  in  Au  it  is  a  non-linking  row.  similarly,  a  period-j 


coluan  Chat  has  non zeroes  In  A 


Is  a  linking  coluan 


Jj  and  Aj+l.J 

whereas  one  that  has  nonzeroes  in  only  Is  a  non-linking  column. 

It  may  be  assumed,  without  loss  of  generality,  that  all  stair¬ 
case  LPs  have  a  constraint  matrix  A  in  standard  form:  A  is  lower  stair¬ 
case,  and  the  diagonal  blocks  A^  have  no  all-zero  rows  or  columns. 

\ 

If  A  is  permuted  to  put  the  linking  rows  of  each  period  first,  and 
the  linking  columns  of  each  period  last,  then  it  also  has  the  follow¬ 
ing  reduced  form: 
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The  intersection  of  period-k  linking  rows  and  period-(k-l)  linking  columns 
is  the  reduced  block  A^ 

If  the  linking  rows  of  every  period  i  are  switched  to  period  1-1 
then  A  gains  an  alternative  row-upper-staircase  form: 
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Switching  the  linking  ootum*  of  period  j  to  period  1  +  1  give*  a  different, 
coluwn-upper-slatroaae  form.  Time  a  a  t  a  1  rcase  A  in  reduoed  standard 
form  embodies  three  staircases--lover ,  row-upper,  and  oo luwn -upper -- 
corresponding  to  three  different  choices  of  where  the  period?  begin  and 
end . 

Staircase  bases 

A«\v  basis  R  of  a  staircase  linear  program  necessarily  Inherits 
a  staircase  structure  from  the  constraint  matrix  A:  R's  staircase  blocks, 
R(  (  j  and  R( ^ ,  mav  be  taken  as  the  sub-blocks  ot  A(  t  ^  and  A(  ( 
that  lie  in  the  basic  columns.  If  A  has  a  reduced  form.  R  may 

likewise  be  taken  as  the  basic  part  of  A^  (  ^ . 

Kither  R^  (  or  1^  (  ^  mav  be  eero  along  some  linking  row  1  if 
it  happens  that,  in  A(  (  or  A^  (  ^ ,  all  the  non  zeroes  along  row  1  art5 
on  non-basic  columns.  Thus  the  inherited  staircase  ot  R  need  not  be 
in  standard  or  reduced  form,  even  it  A  Is. 

Henceforth  any  m  v  m  basis  R  will  be  assumed  to  have  the  stair¬ 
case  form  inherited  from  A.  The  number  of  rows  of  R  in  period  i  will 
be  denoted  m^,  and  the  number  of  columns  of  R  in  period  1  will  be 

s 


I 


denoted  n^;  the  respective  numbers  of  linking  rows  and  columns  will  be 
m^  and  n^ .  For  the  row-upper-staircase  form,  the  number  of  rows  in 
period  i  will  be  m*,  and  for  the  column-upper-staircase  form  the  number 
of  columns  in  period  j  will  be  n^ .  Necessarily  £m^  ■  ^m*  ■  [n^  ■  £n^  »  m, 
and  m^  ^  m^,  n^  Oj  . 


Balance  constraints  and  square  sub-staircases 

Since  the  basis  B  is  nonsingular,  it  must  obey  the  "balance 
constraints"  developed  in  [1].  In  summary,  these  restrict  the  excess  of 
rows  over  columns  in  each  period.  Individually  and  cumulatively,  as  follows: 

0  1  I*  (n1~m1)  <  minCm^.n^)  ,  t  -  1,...,  t-1 

-min^.fij^)  <  (ni-m1)  _<  mindft^.fi^)  ,  k,i  -  1 .  t-1 

-min(mk,nk_1)  <  (n1~m1)  <  0  ,  k  -  2,...,  t 

In  words,  the  cumulative  imbalance  between  rows  and  columns  in  periods  k 
through  l  is  bounded  by  the  smaller  dimension  of  §  ,  and  the  smaller 

K  9  K~*  X 

A 

dimension  of  B^^  Hence  these  constraints  are  quite  strict  when 
there  are  relatively  few  linking  rows  or  columns. 

The  first  constraint  above  may  also  be  written  as  the  following 
three  Inequalities: 

H  -i  i  l\  -i 
ii  \  <  i; 

ii  n  ih  *i 
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These  say  that  the  first  l  periods  of  the  lower  staircase  cannot  haws 
more  rows  than  columns,  while  the  first  l  periods  of  the  associated  row- 
upper  or  colunsi-upper  staircase  cannot  have  more  columns  than  rows. 


All  three  of  these  relations  are  equalities  when  l  ■  t,  since 
B  is  square.  It  can  also  happen  that  equality  is  achieved  for  some 

r*£  c»£ 

i  <  t.  For  example,  if  2.^  nl»  ®  must  look  something  like  this: 


nt 


The  rows  and  columns  of  periods  1  through  i  form  a  square  sub-staircase , 

as  do  the  rows  and  columns  of  periods  i+1  through  t;  they  are  linked 

only  by  nonzero  elements  in  the  off-diagonal  block  Ba+1  In  a  similar 
r£  r  £  1. 

way  an  equality  2j_  m  implies  a  pair  of  square  sub-staircases 

r£  i  r£ 

within  the  row-upper  staircase  form,  and  ^  n  =  ^  m^  implies  the 
same  for  the  column-upper  form. 

Generally  B  may  exhibit  any  or  all  of  these  three  kinds  of 
equalities,  and  each  may  hold  for  several  values  of  l  <  t.  If  p  differ¬ 
ent  such  equalities  hold,  then  B  breaks  into  p+1  disjoint  square 
sub-staircases.  Square  sub-staircases  can  have  a  strong  effect  upon  the 
Iteration  path  of  the  simplex  method,  as  Section  4  will  show. 
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2.  PRICING  IN  THE  SIMPLEX  METHOD 


Each  iteration  of  the  simplex  method  begins  with  the  choice  of  a 
nonbasic  variable  to  enter  the  basis.  The  operations  involved  in  making 
this  choice  are  collectively  referred  to  as  pricing.  Timings  of  staircase 
LPs  in  [2]  show  that  pricing  is  invariably  an  expensive  part  of  the 
simplex  method,  typically  one-third  to  two-thirds  of  the  total  cost. 

This  section  surveys  current  techniques  of  pricing,  to  set  the 
stage  for  discussion  of  staircase  pricing  in  the  sequel. 

To  keep  things  simple  it  will  be  assumed  that  the  problem  is  to 
T 

maximize  c  x,  that  x  is  subject  only  to  explicit  constraints  Ax  *  b 
and  implicit  nonnegativity  (x  >  0),  and  that  a  feasible  basis  is  at  hand. 
Straightforward  extensions  permit  implementation  of  the  composite  simplex 
method  [16,20]  for  infeasible  bases,  and  of  implicit  upper  and  lower  bounds 
of  all  sorts. 

The  constraint  matrix  A  will  be  taken  to  include  the  objective 
as  row  0;  a^  will  be  the  jth  column  of  A.  B  will  represent  a  basis, 
and  B  the  succeeding  basis;  a  tilde  will  also  indicate  other  quantities 
that  have  changed  with  the  basis.  A  unit  column  with  a  1  in  row  j  will 
be  written  e^ . 


Choosing  a  variable  to  enter  the  basis 

Central  to  all  pricing  techniques  are  the  reduced  costs,  d^ , 
j  *  1,...,  n.  If  the  jth  variable  is  nonbasic,  d^  >  0  implies  that  the 
objective  will  Increase  when  j  is  brought  into  the  basis  (at  a  positive 
value),  while  d^  <  0  implies  that  the  objective  will  decrease  when  j 


enters  the  basis.  Thus  the  simplex  method  can  be  guaranteed  to  find  a 


maximum  provided  that,  at  each  iteration,  a  variable  j  having  d^  >  0 
is  chosen  to  enter  the  basis. 

At  most  iterations  there  are  many  "eligible"  nonbasic  variables 
whose  reduced  costs  are  positive.  Any  pricing  technique,  therefore,  must 
incorporate  some  criterion  for  choosing  among  the  eligible  nonbasics. 

Early  experiments  [12,21]  showed  that  the  number  of  iterations 
in  the  simplex  method  ’.s  highly  sensitive  to  the  pricing  criterion. 
Although  it  suffices  to  choose  an  eligible  nonbasic  at  random,  consider¬ 
ably  fewer  iterations  are  required  when  the  chosen  variable  q  has  a 
maximum  reduced  cost : 


d  ■  max,  d. 

q  i  J 


(1) 


This  criterion  produces  the  greatest  improvement  in  the  objective  per 
unit  change  in  the  activity  of  the  nonbasic  variable.  Not  surprisingly, 
the  nuwber  of  iterations  is  further  reduced  when  q  is  chosen  to  maximize 
total  improvement  in  the  objective  at  the  current  iteration. 

Still  better  criteria  have  been  developed  by  extending  (1)  in  a 
different  sense.  Criterion  (1)  can  be  looked  at  as  follows  15]:  it 
chooses  to  move  along  an  edge  of  the  feasible  region  whose  gradient  is 
steepest  in  the  subspace  of  the  nonbasic  variables.  A  superior  criterion 
chooses  instead  a  steepest  edge  in  the  space  of  all  variables.  Writing 
aij  *aj^  ^or  t*1e  c^an8e  basic  variable  per  unit  change 

In  nonbasic  variable  j,  sues,  a  "steepest-edge"  criterion  chooses  q  so 
that 


I 
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In  computational  tests  |S,t>, 12,21]  this  criterion  and  its  variants  have 
consistently  yielded  the  fewest  iterations. 


Computat tonal  considerat ions 

The  efficacy  of  a  pricing  criterion  must  be  balanced  against  the 
computat ional  effort  required.  Generally  a  "better"  criterion  cuts  the 
number  of  iterations  but  requires  more  computation  per  iteration,  so  that 
it  may  or  may  not  be  less  expensive  overall.  For  example,  to  implement 
the  greatest-total-improvement  criterion  one  must  first  determine 


A j  “  min^[ x^/ a  ] 


for  every  nonbasie  j  such  that  d^  >  0;  then  the  incoming  variable  q 


must  satisfv 


d  «  max.  A,d, 

‘1  ^  j  j  J 


These  tests  require  a  prohibitive  amount  of  computation  for  all  but  the 
smallest  LPs. 

Of  all  criteria  that  employ  reduced  costs,  the  gre  test-roducod- 
cost  criterion  (l)  is  certainly  the  simplest  to  implement:  it  requires 
only  the  d^'s.  Moreover,  d^  can  be  computed  efficiently  in  any  of 
three  ways: 


(a)  Solve  B  it  -  e^  for  a  vector  of  prices ,  it .  Then  compute 

.  T 

d3  '  V 

(b)  Update  it  from  the  previous  iteration:  if  nonbasic  variable 

q  replaced  the  pth  basic  variable,  with  pivot  element  a, 

T  ~ 

first  solve  B  v  -  e  for  v,  then  compute  it  =  it  -  (d  /a)v. 

p  q 

~T 

Find  dj  =  ir  a^  as  before. 

(c)  Update  d^  from  the  previous  iteration:  solve  for  v  as  in 

r\j  J 

(b),  then  compute  d.  =  d,  -  (d  /a)v  a.. 

J  J  q  J 

On  average  (c)  requires  the  least  computational  effort  and  (a)  the  most, 
as  explained  in  detail  in  [4,18].  However,  (a)  may  afford  considerable 
savings  if  not  all  d^'s  are  computed  at  each  iteration  (as  in  "partial 
pricing"  discussed  below);  in  addition,  with  (a)  not  all  of  it  need  be 
computed  for  staircase  problems  (as  explained  in  Section  3).  Method  (b) 
also  allows  partial  pricing  but  must  compute  all  of  tt;  partial  pricing  is 
impractical  with  (c),  which  must  find  every  d^  at  each  iteration.  For 
staircase  problems  a  hybrid  of  (a)  and  (b)  may  be  desirable,  as  Section  3 


shows . 


Steepest-edge  criteria  (2)  replace  d^  by  a  more  complicated 


function, 


d^/vA  +  l 


Two  practical  implementations  compute  or  approximate  this  function  as 
follows: 

(d)  Goldfarb  [5]  stores  an  additional  set  of  weights,  y  =  1  +  £  a  , 
which  are  updated  at  each  iteration.  The  incoming  column  may 
then  be  chosen  to  maximize  the  square  of  the  above  function. 


dj/-fj,  over  all  nonbasic  j  such  that  d^  >  0. 
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(e)  Harris  [6]  Cakes  a  similar  approach,  but  employs  weights 
Tj  ~ vA  +  1  a^j  that  are  updated  at  most  iterations  and  , 
reset  to  1  when  they  become  too  inaccurate.  The  incoming 


variable  is  chosen  to  maximize  d^/T^. 


The  advantage  of  (e)  is  that  it  requires  only  slightly  more  computation 

T 

than  (a)-(c),  whereas  (d)  must  solve  an  extra  linear  system  with  B  and 

must  compute  extra  inner  products.  On  the  other  hand,  (d)'s  more  accurate 

criterion  tends  to  find  an  optimum  in  fewer  iterations.  Both  (d)  and  (e) 

T 

must  update  all  weights  at  each  iteration  by  solving  B  v  =  e  ,  computing 
T 

v  a^  for  nonbasic  j,  and  additional  steps;  the  d^’s  are  thus  cheaply 
updated  at  the  same  time  by  method  (c) .  However,  any  efficiencies  of 
method  (a)  or  (b)  through  partial  pricing  are  lost. 


Partial  pricing 

All  of  the  above  methods  involve  an  inner  product  to  compute  each 
T  T 

d^:  either  ir  a j  for  (a) -(b),  or  v  a^  for  (c)-(e).  Vector  a^  is 
usually  very  sparse,  so  that  only  its  nonzero  elements  and  their  row 
indices  need  be  stored.  Hence  any  one  of  these  inner  products  can  be 
computed  cheaply.  Nevertheless,  the  total  cost  of  these  products  for  all 
dj's  may  be  substantial,  especially  if  the  LP  has  considerably  more  vari¬ 
ables  than  constraints. 

Partial  pricing  attempts  to  speed  up  method  (a)  or  (b)  by  consider¬ 
ing  only  some  of  the  nonbasic  variables  as  candidates  to  enter  the  basis 
at  each  Iteration.  Only  d^'s  ^or  these  candidate  nonbasics  are  needed, 
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and  hanoa  fewer  Innar  product  a  arc  computed.  tt  the  sot  of  candidates 
1*  kept  small,  the  coat  of  an  iteration  can  he  markedly  reduced.  However, 
the  number  of  iterations  tends  to  he  greater  under  partial  pricing  since 
superior  potential  candidates  are  often  left  out  of  the  candidate  set. 

Partial  pricing  la  thus  essentially  a  matter  of  trading  more 
iterations  for  leas  work  per  iteration.  A  good  part lal-pr icing  scheme 
chooses  candidate  sets  that  make  this  tradeoff  a  tavoraMc  one.  Hie 
simplest  schemes  part  it  ton  the  variables  into  a  fixed  collection  of 
candidate  sets  that  are  priced  in  rotation;  more  sophist icated  schemes 
determine  the  candidate  seta  dynamically,  stopping  when  a  "good  enough'" 
reduced  cost  has  been  found.  Dynamic  partial  pricing  mav  be  viewed 
mathematically  as  a  complicated  opt Imal-Ntopplng  problem  in  which  t  he 
distribution  of  the  reduced  costs  is  unknown  and  gradual Iv  changing. 

Some  attempt  has  been  made  tv'  solve  this  problem  svst emat leal  I v  1/1;  loi 
the  moat  part,  however,  part ial -pricing  scheme's  have  employed  heuristics 
chosen  because  thev  seemed  reasonable  and  worked  adequately. 

The  n umhei  of  implemented  strategies  tor  partial  pricing  is 
Immense  -probably  no  two  large  scale  systems  price  in  exactly  the  sans' 
wav.  It  there  ate  anv  common  principles,  thev  are  to  avoid  stopping 
prematurely  with  too  small  a  reduced  cost ,  and  t o  stop  promptly  once  a 
big  reduced  cost  t»  found  Erasures  of  what  Is  t oo  small  and  what  is 
big  may  he  either  absolute  or  relative:  absolute  tests  compare  reduced 
costa  with  threshold  values  that  are  set  Initial Iv  trom  experience  or  bv 
a  heuristic  algorithm,  and  ate  updated  as  the  magnitude  ot  reduced  costs 
declines;  relative  tests  make  comparisons  only  among  reduced  coats  found 
at  the  current  Iteration. 

I  1 


Storage  considerat  tons  ami  multiple  pt icing 

I'artlal  pi  King  Is  especially  atttactlve  when  the  columns  a^ 
are  not  stored  lu  li  l  gh-speed  memorv,  so  that  cornput  ton  d^  Involws  read 
titH  a^  Into  memorv  as  well  an  an  Inner  product .  To  nave  mailing  conln, 
some  Implement  at  Ions  operate  an  follows:  at  "ma|oi"  iteiattons  a  tegulat 
partial  prioe  Is  cart  led  out,  ami  a  suhset  of  attiaetfve  camttdate 
columns  Is  saved  In  high-speed  memorv;  at  subsequent  "mtnot"  notations 
on  l  v  this  candidate  suhset  Is  pt  teed.  This  soil  ot  "multiple"  pilefng 
mav  also  he  viewed  as  a  part tal -pricing  sehomo  that  gives  pteletettce  to 
varlahles  whose  reduced  oost  s  were  high  In  previous  notations. 

Storage  consldet  at  Ions  have  .lee  lined  In  tmpotlauce  with  the  advent 
of  paged  machines  that  van  vheaplv  slmnlate  large  memo  tv  regions  lot  It’ 
codes.  Interest  in  multiple  pricing  has  thus  declined  as  well,  and  the 
experiments  In  this  paper  nse  sfmplet  part  tat  pr Icing  schemes.  Anv  ol 
these  schemes  could  he  adapted,  h»*wevet ,  to  admit  multiple  pricing. 

ll  Is  possible  that  some  vet  s  tons  of  part  tal  01  mull, pie  pi  (dug 
are  more  economical  for  paged  computers  because  they  tend  io  access  lewei 
different  pages  of  memorv  per  Iteration,  h'conomtcs  ot  this  sol  t  would 
probably  he  small,  however,  and  so  toi  piesent  put  poses  the  effects  ot 


paging  have  been  disregarded . 
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3.  COMPUTING  PRICES  FOR  STAIRCASE  LPs 


Consider  now  a  linear  program  of  staircase  structure.  Suppose 

chat  the  reduced  cost  of  nonbasic  column  j  is  to  be  computed  by 
T 

dj  ■  it  Sj  in  method  (a)  or  (b)  of  the  previous  section.  If  is  from 

period  1  then  it  has  nonzero  elements  only  on  rows  of  periods  i  and  £+1; 

T 

as  a  consequence,  the  inner  product  tt  a^  requires  only  elements  of  n 
that  correspond  to  period-8,  and  period-(8+l)  rows. 

More  generally,  if  a^  is  a  column  from  period  8  or  later,  then 
its  reduced  cost  can  be  calculated  from  only  those  elements  of  n  that 
correspond  to  rows  of  period  8  or  later.  This  statement  is  true  for 
higher-order  staircases  as  well  as  first-order  ones. 

These  facts  would  be  of  no  practical  importance  if  all  dj's  were 
calculated  at  every  iteration.  However,  under  partial  pricing  most 
candidate  sets  will  contain  variables  of  only  certain  periods,  and  so  at 
most  Iterations  only  part  of  tt  will  really  be  needed.  The  cost  of 
pricing  might  therefore  be  reduced  if  only  the  needed  part  of  7r  were 
computed. 


Selective  computation  of  the  price  vector 

In  practice  there  is  no  efficient  way  to  compute  arbitrary  elements 

of  n  independently  of  the  other  elements.  Nevertheless,  useful  portions 

of  it  can  be  computed  more  cheaply  than  all  of  it,  provided  that  the 

basis  is  arranged  in  an  appropriate  way. 

Consider  first  method  (a)  of  the  preceding  section,  which  finds  n 
T 

as  the  solution  of  B  tt  »  e^.  Current  LP  codes  solve  this  system  by  a 
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torn)  of  Gmiiss  lan  elimination,  as  explained  In  detail  in  |2|.  After  a 
series  of  various  computations  (whose  specifies  are  not  Important  here) 
the  elements  of  «  are  finally  produced  hy  a  routine  called  BTRANl. . 
Essentially  BTRANl.  comprises  a  single  main  loop; each  pass  through  this 
loop  computes  a  new  element  of  n  from  the  previously-computed  elements. 

Thus  a  portion  of  «  can  bo  computed  by  slmplv  stopping  BTRANl.  prematurely. 

If  later  more  of  n  Is  needed,  BTRANl,  can  be  restarted  where  It  lett  off. 

Unfortunately  BTRANl,  cannot  produce  the  elements  of  n  In  any 
desired  order;  Instead  It  must  compute  "  In  a  fixed  order  that 
corresponds  to  the  ordering  of  B's  rows  for  Gaussian  elimination. 

Standard  methods  of  elimination  choose  a  row  ordering  for  efficiency  and 
numerical  stability,  without  regard  to  the  periods  ol  the  staircase. 

As  a  result  BTRANl,  tends  to  produce  elements  of  n  from  various  periods 
indiscriminately,  and  It  may  be  necessary  to  run  most  of  BTRANl,  to  compute 
all  elements  of  *  for  even  one  period. 

To  compute  portions  of  ti  usefully,  therefore,  B's  ordering  for 
Gaussian  elimination  must  preserve  the  staircase  structure.  IVo  such 
orderings  are  described  in  (1,21  :  both  leave  the  rows  of  the  basis  In 
or  nearly  in  period  order.  BTRANl,  then  produces  the  elements  ol  n 
in  nearly  reverse  period  order:  t,  t-1,  ...  ,  2,  l. 

With  these  staircase  orderings  it  is  practical  to  selectively 
compute  n.  If  the  partial-pricing  scheme  starts  with  columns  from 
period  <,  then  BTRANL  Is  called  to  compute  a  for  periods  t,  t-1,...,  t  +  l,  < 
only.  This  portion  of  n  will  suffice  so  long  as  all  candidates  are 
in  period  t  or  later.  If  some  candidate  falls  in  an  earlier  period, 
say  k,  then  BTRANl.  Is  resumed  where  it  left  of l  to  compute  *  for  periods 


lb 


l-l ,  ...  ,  k+1,  k.  BTRANL  may  be  restarted  in  this  way  several  times 

if  the  candidate  set  includes  successively  earlier  periods. 

The  savings  in  computing  only  part  of  it  can  be  significant: 

BTRANL  is  inherently  a  relatively  expensive  routine  and  accounts  for 

T 

most  of  the  cost  of  solving  Bn-  e^.  A  set  of  six  test  problems  in 

[2]  spent  roughly  15-20%  of  their  total  time  in  BTRANL,  or  20-25%  of 

their  time  if  only  iterating  routines  were  considered. 

Actual  savings  necessarily  depend  on  the  chosen  pricing  scheme. 

If  the  candidate  set  usually  contains  variables  from  early  periods  then 

little  will  be  gained;  preferably  the  candidate  set  is  confined  to  later 

periods  at  a  good  proportion  of  iterations.  For  best  results  one  may 

use  special  staircase  partial-pricing  methods,  which  are  the  topic  of 

Section  5. 

Selective  updating  of  the  price  vector 

It  can  be  faster  to  update  n — by  method  (b)  of  Section  2 — than 
T 

to  recompute  ir  from  B  n  ■  e^.  However,  a  full  update  requires  a  lull 

T 

solution  to  system  like  B  v  =  e^>  and  it  will  usually  be  cheaper  to 

T  T 

solve  B  »  *  e^  for  part  of  tr  than  to  solve  B  v  ■  e^  for  all  of  v. 

Thus  full  updating  of  n  should  be  disadvantageous  for  staircase  Li’s 

under  partial  pricing. 

Selective  updating  is  a  practical  alternative.  Suppose  n  is 

known  for  periods  t,  while  at  the  next  iteration  n  will  be  needed 

for  periods  k,  ...,  t.  If  k  >  t,  it  can  simply  be  updated:  first 
T 

B  v  *  e^  is  solved  by  BTRANL  for  petiods  t,...,  k  only; then  periods  k 
through  t  of  If  are  found  by  the  updating  formula 
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*  ■  «.  -  (d  / a)v. 

11  q  1 


On  the  other  hand,  if  k  «.  t  then  n  can  he  updated  only  as  far  back  as 

period  1.  The  remainder  of  n  must  be  found  by  solving  B  n  •  e^  in 

the  usual  way — except  that  BTRANL  may  skip  the  computation  of  n  for 

periods  t,...,  i.  (Alternatively,  If  it  is  known  that  k  v  t  before 

pricing  begins  then  it  may  be  cheaper  to  drop  the  update  step  and  Just 
T' 

solve  B  n  -  ey  for  periods  t,...,  k  of  x.) 

Selective  updating  is  essentially  a  hybrid  of  methods  (a)  and  (b) 
of  Section  2.  It  might  be  possible  to  also  include  (c)  in  the  hybrid, 
so  that  some  d^'s  are  updated  from  v  rather  than  being  computed  from 
n .  However,  it  is  not  clear  that  the  additional  savings  would  be  worth 
the  extra  complications. 

In  any  event,  the  steepest -edge  methods — (d)  and  (e) — must  compute 
all  of  v  to  update  their  wights,  regardless  of  which  d^'s  they  examine. 
Hence  these  methods  require  a  full  BTRANL  at  every  iteration,  and  cannot 
benefit  from  selective  computation  or  updating  of  n. 
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4.  ITERATION  PATHS  OF  STAIRCASE  LPs 

The  choice  of  a  variable  to  enter  the  basis  also  largely  determines 
the  variable  that  leaves.  Thus  different  pricing  techniques  should  be 
expected  to  produce  different  sorts  of  iteration  paths  in  the  simplex 


method. 


For  staircase  LPs  the  connection  between  pricing  and  Iteration 


path  can  be  especially  strong  and  clear.  This  section  shows  that,  when 
the  staircase  basis  has  a  certain  sub-structure,  an  entering  variable  from 
a  given  period  must  determine  a  leaving  variable  from  a  certain  range  of 
periods.  Moreover,  the  basic  solution  is  unchanged  outside  of  this  range. 
These  observations  contribute  to  the  design  of  staircase  partial-pricing 
schemes  in  Section  5. 


Restrictions  on  the  outgoing  column 

Suppose  first  that  the  basis  has  a  square  lower-block-triangular 

form: 


Assume  further  that  the  Incoming  column  q  is  zero  on  all  of  the  rows  of 
®(11)*  Then  it  is  easy  to  see  that  the  outgoing  column  must  be  from 
B(22)  •’  otherwise  B(22)  would  gain  a  column  and  the  new  basis  would  be 
singular.  In  short,  if  the  incoming  colunn  belongs  to  the  second  block 
then  so  does  the  outgoing  column. 

Consider  now  the  values  of  the  basic  variables.  They  satisfy 
Bx  *  b,  where  b  is  the  LP's  right-hand  side;  partitioning  x  and  b 
in  conformance  with  the  blocks  of  B, 


Bdl)X 


(1) 


(1) 


B  x(1)  +  B  *(2)  -  h{2) 
B(2i)X  +  B(22)x  b 


When  column  q  above  is  brought  into  the  basis,  only  B^22)  is  altered; 
consequently,  basic  variables  x^^  are  unchanged.  In  sum,  if  the  in¬ 
coming  colunn  belongs  to  the  second  block  then  the  basic  solution  changes 
only  in  that  block. 

A  parallel  analysis  applies  to  any  square  upper-block-triangular 
form  of  B: 


B(U) 

B  (12) 

1 

1 

1 

1 _ 

B  (22) 

(4) 
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If  the  Incoming  column  belongs  to  the  first  block  then  so  does  the  out¬ 
going  column,  and  the  basic  solution  changes  only  in  the  first  block. 

Putting  these  observations  together,  B  can  be  imagined  to  have 
a  form  like  this: 


B(U) 

1 

l 

B  (21) 

B  (22) 

B  (23) 

1 

1 

1 

1 _ _ 

B  (33) 

where  are  a11  square.  B(22)  is  both  parC  °f  a  lower-trianfcular 

block  (with  B(33))  and  Part  of  an  upper-triangular  block  (with  B^j). 
Thus  if  the  incoming  column  belongs  to  the  middle  block  ^B(22)^  then 
so  does  the  outgoing  column,  and  the  basic  solution  changes  only  in  the 
middle  block. 

Restrictions  on  the  outgoing  column  of  a  staircase  basis 

Typical  bases  have  many  block-triangular  partitions,  and  this 
fact  is  used  to  advantage  in  sparse  Gaussian  elimination  |1).  However, 
there  is  generally  no  clear  relation  between  these  blocks  and  the  structure 
of  the  linear  program.  As  a  result  there  is  no  easy  way  to  keep  track 
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ot  the  blocks  from  Iteration  to  iteration,  and  there  is  no  reason  to 
expect  that  an  incoming  column  will  belong  to  one  block  or  another. 

The  situation  is  quite  different  when  b  has  a  staircase  form. 
Then  any  square  sub-staircase — as  defined  in  Section  1 — comprises  a  square 
diagonal  block.  Square  sub-staircases  are  easily  kept  track  ol  t rom 
iteration  to  Iteration  since  they  are  defined  by  simple  relat Ions  like 

r*  (  r*  \ 

'  m^  *  ^  n^.  Moreover,  there  is  every  reason  to  expect  that  an  incoming 
variable  may  lie  entirely  with  a  square  sub-staircase. 

As  a  consequence  stronger  statements  can  be  made  about  the  itera¬ 
tion  path  of  staircase  Id's.  Recall  trow  Section  1  that  lower  square  sub- 
staircases  arise  when  m  •  n  for  some  i  c  t.  In  diagram  i  D 
above,  let  B  represent  the  sub-staircase  of  the  first  <  periods, 

while  is  the  sub-staircase  of  periods  <  M  through  t;  B  |  con¬ 

tains  tin'  linking  block  b,  ,  ..  Then  anv  incoming  column  from  periods 
v+l  through  t  must  lie  in  b^,,^.  The  conclusions  ot  the  preceding 
subsection  can  now  be  applied  to  imply  that 

•  If  V ^  n , ,  and  if  the  incoming  column  is  from  periods 

<+!,...,  t,  then  the  outgoing  column  Is  also  from  periods 
t  +  l,...,  t  and  the  activities  of  vat  tables  in  periods 
l .... ,  i  do  not  change . 

Upper  square  sub-staircases  arise  similarly  in  connection  with  the  row- 
upper  and  column-upper  forms  of  b  defined  in  Sect  ion  1.  by  analogous 
reasoning  in  conjunction  with  diagram  14),  it  can  also  be  concluded  that 


•  If  m*  »  n^,  and  if  the  incoming  column  is  from  periods 

1,...,  (,  then  the  outgoing  colunn  is  also  from  periods 

1,...,  I  and  the  activities  of  variables  in  periods  £+1,...,  t 
do  not  change. 

r£  rl  i 

•  If  2.^  m  »  I2  n  *  anc*  *ncomi-n8  column  is  from  upper- 

staircase  periods  1,...,  £,  then  the  outgoing  column  is  also 
from  upper  periods  1,...,  £  and  the  activities  of  variables 
in  upper  periods  £+1,...,  t  do  not  change. 

(As  defined  in  Section  1,  the  upper-staircase  periods  1,...,  £  comprise 
the  corresponding  lower-staircase  periods  less  the  period-!!,  linking 
columns. ) 

In  the  general  case  B  may  contain  both  upper  and  lower  sub¬ 
staircases,  producing  a  situation  as  in  diagram  (5) .  Roughly  speaking, 

if  periods  1 .  k  form  a  lower  square  sub-staircase  and  periods 

£+1,  ....  t  form  an  upper  one,  then  an  incoming  column  from  periods 
k+1 , . . . ,  £  yields  an  outgoing  column  from  the  same  periods  and  leaves 
activities  outside  these  periods  unchanged. 

Since  staircase  bases  must  be  well-balanced  (Section  1)  the 
presence  of  square  sub-staircases  should  not  be  unusual.  Indeed,  results 
of  test  runs  suggest  that  bases  exhibit  several  square  sub-staircases 
more  often  than  not.  Furthermore,  it  must  be  kept  in  mind  that  the  above 
statements  apply  to  any  staircase  partitioning  of  the  LP,  not  just  to 
the  staircase  identified  by  the  modeler.  Hence  a  number  of  other  square 
sub-staircases  may  go  unidentified. 
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Prevalence  of  square  sub-staircases  is  also  suggested  by 
iteration  paths  of  test  runs:  only  infrequently  is  the  outgoing 
more  than  a  few  periods  from  the  incoming  one.  For  example,  the 
problems  of  Section  6  (under  full  pricing)  show  the  incoming  and 
variables  two  or  fewer  periods  apart  in  592,  742,  85%,  94%,  97%, 
of  a’l  iterations. 


the 

co  1  umn 
six  test 
outgoing 
and  98% 


Implications  for  pricing 

Square  sub-staircases  may  be  viewed  generally  as  creating  barriers 
to  pricing  at  certain  periods.  A  lower  sub-staircase  in  periods  1  through 
i,  for  example,  places  a  lower  barrier  at  i :  if  the  incoming  column  is 
below  the  barrier  then  the  outgoing  column  is  also  below  the  barrier,  only 
basic  activities  below  the  barrier  are  changed,  and  the  barrier  remains 
at  the  next  iteration.  The  basis  and  basic  activities  above  the  barrier 
can  change  only  if  the  incoming  column  is  above  the  barrier,  and  the 
barrier  is  removed  only  if  additionally  the  outgoing  column  is  below  it. 

These  facts  have  important  implications  for  partial  pricing.  So 
long  as  the  candidate  set  lies  in  periods  below  a  lower  barrier,  activities 
in  periods  above  the  barrier  are  unchanged.  In  effect,  pricing  below  the 
barrier  suboptimizes  the  LP  in  the  below-barr ier  periods,  while  fixing 
the  above-barrier  periods.  By  contrast,  pricing  above  the  barrier 
optimizes  all  the  periods  and  tends  to  break  the  barrier  down. 

Upper  sub-staircases  naturally  have  an  analogous  but  opposite 
effect:  they  create  upper  barriers  at  certain  periods.  Pricing  above 
an  upper  barrier  suboptimizes  the  LP  in  above-barrier  periods,  while  fixing 
the  below-barrier  periods. 
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In  general  a  basis  can  have  several  upper  and  lower  barriers. 

Thus  pricing  in  any  one  period  suboptimizes  the  periods  between  the  nearest 
preceding  lower  barrier  and  the  nearest  succeeding  upper  barrier,  fixing 
the  others. 

As  long  as  the  basis  tends  to  have  square  sub-staircases, theref ore , 
partial  pricing  will  tend  to  promote  suboptimization.  This  may  be  a  good 
thing  if  the  suboptima  are  near  the  true  optimum,  or  a  bad  thing  if  the 
suboptima  are  far  from  optimal.  Both  extremes  were  observed  in  the  com¬ 
putational  experiments  in  Section  6. 

Partial-pricing  schemes  can  be  devised  either  to  encourage  or 
discourage  suboptimization.  Pricing  the  same  periods  repeatedly  tends  to 
create  barriers  and  suboptimize,  while  pricing  throughout  the  matrix  tends 
to  do  the  opposite.  It  is  also  possible  to  keep  track  of  the  number  of 
columns  in  each  period  so  as  to  price  where  barriers  will  most  likely  be 
created  or  destroyed.  Strategies  along  all  of  these  lines  are  developed 
in  the  following  section. 
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5.  PARTIAL  PRICING  FOR  STAIRCASE  LPs 

It  is  now  clear — given  the  results  of  the  two  preceding  sections 
— that  any  partial-pricing  scheme  for  staircase  LPs  should  distinguish 
among  variables  of  different  periods.  Consequently  all  of  the  methods 
proposed  below  price  essentially  one  period  at  a  time.  These  methods 
differ  considerably,  however,  in  their  choices  of  periods  to  price  and 
in  their  stopping  criteria. 

Four  general  procedures  for  staircase  pricing  are  presented  first 
below.  Subsequent  subsections  propose  and  evaluate  specific  variations 
on  these  procedures. 


Simple  pricing  by  period 

All  methods  of  partial  pricing  by  period  involve  some  ordering  of 
(k)  (k)  (k) 

the  periods — p^  ,  p2  , ....  pf  — at  each  iteration  k.  Assume  for  the 

moment  that  such  an  ordering  has  been  chosen,  according  to  one  of  the 

principles  suggested  later  in  this  section. 

The  most  straightforward  method  first  takes  the  nonbasics  of 
(k) 

period  p^  as  the  candidate  set.  If  any  of  these  variables  has  a 

favorable  reduced  cost,  one  having  a  largest  reduced  cost  is  chosen  to 

(k) 

enter  the  basis.  Otherwise  the  nonbasics  of  period  are  added  to 

the  candidate  set;  if  any  of  these  has  a  favorable  reduced  cost,  a  best 

(k)  (k) 

one  is  chosen.  If  necessary,  the  process  repeats  with  p^  ,  p^  ,...,  p 
stopping  when  a  favorable  d^  is  found  in  some  period.  If  no  favorable 


dj  is  found,  the  current  basis  is  optimal. 


(k) 
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This  procedure  will  be  called  simple  pricing  by  period.  A 


practical  algorithm  to  carry  it  out  is  as  follows: 

SlMVhR  THIC1  Nil : 

1  :  KKl'KAT  Fv>R  <  FROM  1  TO  t  : 

llHOOSK  q.  such  that  d  N  «.!  for  all  )  in  period  p/^ 
'  J  v 

1 K  d  N  i  select  q  to  enter  basis;  RKTURN 

*1(  ' 

2:  (TIOOSK  q  such  that  d  N  d  tor  c  »  1,...,  t 

11  ‘*V 

IF  d  s  ,  :  Select  q  to  enter  basis;  RF.Tl'RN 

q 

1:  hectare  basis  optimal;  RKTl'RN 


Two  tolerances  are  employed.  A  fixed  tolerance,  i  ,  defines  the  smallest 

reduced  cost  that  is  considered  different  from  rero.  A  dynamic  tolerance, 
(K 1 

i  N  «■  ,  defines  an  "acceptable"  reduced  cost :  step  1  ot  the  algorithm 

(k) 

will  not  let  variable  q^  enter  the  basis  unless  d  s  \  .If 
(k) 

d|  v  i  for  all  I,  then  step  2  may  select  an  entering  column  q 

i  ,  i 

having  i  v  d  m 

i  k  1 

A  subsidiary  algorithm  is  required  to  update  \  at  each  it  era- 

ik  1 

t ion .  The  general  idea  is  t o  pick  i  large  enough  that  the  chosen 

d  is  not  too  far  from  max  d.,  but  small  enough  that  only  one  or  two 
A  J  J 

iL  ) 

periods  are  priced  at  most  Iterations.  For  all  tests  in  Sect ( on  A,  t 


is  updated  in  the  to! lowing  way: 


-  ,0* 

1:  l F  .1  '  ,‘k\  ,0*0  .  I  (,(0 

* 

'■  IV  i  .  ,  ikfll 

:  Irdvi  :  i  -  >  d 

q  q 


id  1 

q 


(k) 

In  effect  t  is  a  fraction  >  of  a  running  average  ol  the  choaen 

reduced  costs  d  .  To  get  a  good  starting  value,  is  set  to  "infinity," 

(2) 

forcing  t  -  > d^  in  step  2;  subsequent Iv  step  1  updates  the  moving 

average,  and  step  2  is  Invoked  only  if  all  reduced  costs  fall  below 
(k) 

t  .  For  a  range  of  test  problems  (Section  b)  a  >  of  0.'  or  0.S 
usually  gave  best  results. 


Simple  prlc ing  with  threshol  d 

Simple  pricing  by  period  might  ho  improved  hv  adding  a  move 

sophisticated  stopping  rule.  For  example,  a  "desirable"  reduced  cost 

(k)  (k) 

can  be  defined  by  a  value  T  >  rv  at  each  iteration:  any  variable 
(k) 

with  dj  2  T  i«  Immediately  brought  Into  the  basis  without  further 

tk ) 

pricing.  If  all  reduced  costs  lit  a  period  are  less  than  T  ,  then  a 

(k) 

variable  with  d^  N  t  may  he  chosen  as  be'ore. 


This  strategy  will  he  called  simple  pricing  with  threshold  T 
it  is  described  algorithmically  as  follows: 


Ik) 


SJMPl . E  PRJC1 NC  W 1 TH  THRKSHO U) : 

1 :  REPEAT  FOR  «  FROM  1  TO  t : 

l.l:  REPEAT  FOR  J  nonbasic  in  period  p(lk>: 
,(k) 


IF  d(  >  T' 


Select  f  to  enter  basis;  RETURN 


1.2:  CHOOSE  q  such  that  d  N  d  for  all  )  in  period  p' 

*1^.1  f 


(k) 


IE  d  >  i 

q< 


(k) 


:  Select  q^  to  enter  basis;  RETURN 


2:  CHOOSE  q  such  that  d  >  d  for  f  -  I,...,  t 

q  qf 

IF  d^  >r:  Select  q  to  enter  basis;  RETURN 
3:  Declare  basis  optimal;  RETURN 
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(k)  (k) 

T  must  be  determined  along  with  t  at  each  iteration.  Experiment 

of  Section  6  use  the  formula 


T(k)  -  |-(T(k)/y) 


(k) 

update  algorithm  above.  Since 
is  basically  y  times  a  running  average  of  previous  reduced  costs, 

T'"'  is  a  multiple  T  of  the  same  running  average.  A  I'  of  1.1  was 

used  for  most  tests  in  Section  6. 


where  y  is  the  parameter  for  the  t 

T  (  k  ) 

,(k) 


Continuous  pricing  by  period 

It  is  fastest  and  simplest  to  price  the  variables  of  each  period 

in  some  fixed  order.  As  a  result,  however,  simple  pricing  with  theshold 

tends  to  favor  the  earlier  variables  in  each  period:  a  later  variable 

(k) 

is  priced  only  if  d^  <  T  for  all  of  the  earlier  ones. 

To  remedy  this  situation,  the  pricing  algorithm  may  be  modified 

so  that  it  always  continues  where  it  left  off  at  the  preceding  iteration. 

(k-1)  (k-1) 

More  precisely,  suppose  that  variable  q  of  period  p  was 

chosen  to  enter  the  basis  at  period  k-1.  Then  the  revised  algorithm, 
called  cont inuous  pricing  by  period,  proceeds  as  follows: 


CONTINUOUS  PRICING: 

0:  IF  q^k  ^  is  not  the  last  variable  in  period  p^k 

0.1:  REPEAT  FOR  j  nonbasic  in  period  p^k  ^  FROM  q^k  '^+1 : 

(W\ 

IF  dj  >  Tv  Select  J  to  enter  basis;  RETURN 
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0.2:  CHOOSE  q_  such  that  d  2  s*,  f°r  j  priced 

u  %  i 
in  step  0. 1 

(k) 

IF  d^  >  T '  :  Select  q^  to  enter  basis;  RETURN 


REPEAT  FOR  l  FROM  1  TO  t: 


fk)  fk-1) 

1.1:  REPEAT  FOR  j  nonbasic  in  period  p£  (TO  qv  ’ 


IF  p 


(k) 


_  (k— 1) \ . 
P  >  • 

-<k) 


IF  dj  2  T  :  Select  j  to  enter  basis;  RETURN 


1.2:  CHOOSE  q^  such  that  d  2  for  fllf  J  in  period  p? 
(kl  * 

IF  d  >  rv  :  Select  q.  to  enter  basis;  RETURN 
’« -  1 

2:  CHOOSE  q  such  that  d  >  d  for  t  *  0,...,  t 

q  ~  Qt 

IF  d  >  e:  Select  q  to  enter  basis;  RETURN 

q  _ 

3:  Declare  basis  optimal;  RETURN 


(k) 


Repeated  pricing  by  period 

A  special  case  of  continuous  pricing  always  chooses  the  first- 

(k) 

priced  period  of  the  current  iteration,  p^  ,  to  be  the  last-priced  period 

(k— 1 ) 

of  the  preceding  iteration,  p  .  It  is  easily  seen  that  the  effect  of 

(k-1) 

such  a  strategy  is  to  price  all  of  period  p  before  any  of  the  other 

periods,  in  a  cyclic  fashion.  As  a  consequence  the  incoming  variable  is 

(k-1) 

likely  to  again  lie  in  p  .  Indeed,  the  incoming  variable  will  be 

(k-1)  (k) 

chosen  repeatedly  from  p  until  d^  <  t  for  every  j  in  that 

period. 

This  idea  of  repeated  pricing  by  period  can  be  implemented  as  a 
separate  (though  similar)  algorithm,  as  follows: 


30 


REPEATED  PRICING 


0: 


0.1:  REPEAT  FOR  j  nonbasic  In  period  p 
(k-1) 


(k-1) 


FROM  q  +1  TO  end,  and  FROM  start  TO  q 

n<k> 


(k-1) 


IF  dj  >  T  :  Select  j  to  enter  basis;  RETURN 

0.2:  CHOOSE  qn  such  that  d  _>  d,  for  all  J  In  period  p 

u  q0  J 

(k)  U 

IF  d  >  tv  Select  qn  to  enter  basis;  RETURN 

%  u 

1:  REPEAT  FOR  l  FROM  1  TO  t  (UNLESS  p£k)  -  p(k_1)) : 

[same  step  1  as  simple  pricing  with  threshold] 

2:  CHOOSE  q  such  that  d  >  d  for  i  «  0,...,  t 

q  “  q* 

IF  d  >  e:  Select  q  to  enter  basis;  RETURN 
<1  ~ 

3:  Declare  basis  optimal;  RETURN 


(k-1) 


Pricing  cyclically 

It  remains  to  specify  how  the  periods  will  be  ordered  for  any 

of  these  four  algorithms.  Computational  experience  has  shown  that  choice 

of  an  ordering  is  often  critical;  sometimes  running  times  vary  much  more 

between  different  orderings  than  between  different  algorithms. 

An  obvious  "neutral"  ordering  is  a  cyclic  one  that  starts  wherever 

(k-1) 

pricing  left  off  at  the  previous  iteration.  Writing  p  for  the 

last-priced  period  at  iteration  k-1,  a  "forward"  cyclic  order  at  iteration 
k  prices 


(k-1.)  -  (k-1)  _ 

P  +1.  P  +2, 


t,  1 ,  2, 


n(k-D  , 

P  i» 


(k-1) 


or,  more  formally. 
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p(k-1}  +  « 


it  p(k_1)  +  e  ^  t 


p(k'l)  +  «  -  t  if  p(k_l)  +  «  >  t 

Similarly  a  "backward"  cyclic  order  is  p^k  ^-l,...,  1,  t,  ...,  p^k 
Cycli  c  orderings  are  suitable  to  any  of  the  above  algorithms. 
Simple  or  continuous  pricing  with  a  cyclic  order  should  discourage  sub¬ 
opt  imlzat ion,  since  the  candidate  set  is  rotated  among  all  the  periods. 
Repeated  pricing,  on  the  other  hand,  tends  to  favor  suboptimizat ton  since 
it  prices  the  same  period  repeatedly.  With  a  cyclic  ordering,  however, 
repeated  pricing  always  moves  on  to  period  C+l  when  it  has  finished  with 
period  <,  so  at  least  the  suboptimization  proceeds  cyclically  through  all 
the  periods. 

Many  partial-pricing  methods  for  general  l.Ps  use  a  kind  of  cyclic 

..  i i  i  .■  .  (1  1  )  ....  .  v.  ..1.. i  ...  I  ...  i  ........  1  ...  1,  t  ,1.... 


ordering:  if  J 


was  the  last  column  priced  at  iteration  k-l,  then 


(k~l) 

pricing  at  iteration  k  begins  with  column  1  +1  for  with  column  1  if 

(k-l) 

J  is  the  last  column  of  the  LP),  and  continues  cyclically  through 

all  the  nonbasic  columns  until  some  stopping  rule  is  invoked.  Cyclic 

continuous  pricing  by  period  is  quite  similar,  although  its  stopping  rule 

does  take  the  periods  into  account. 

If  the  price  vector  is  only  partially  computed  as  suggested  in 

Section  3,  then  forward  cyclic  pricing  is  preferable.  At  the  start  of 

(k-l) 

pricing,  the  vector  n  is  computed  for  periods  t,...,  p  +1  only; 
in  most  cases  no  more  of  *  will  be  needed.  The  remainder  of  n  is 
computed  only  at  iterations  in  which  period  l  is  priced. 

Since  extra  computation  is  required  at  period  1,  it  may  pay  to 
apply  a  weaker  tolerance  t^k*  after  periods  p^k-1^  +  l, .  . . ,  t 


.12 


~(k) 

have  been  priced:  it  d^  2  1  for  any  variable  in  these  periods,  the 

best  candidate  so  far  is  selected  and  pricing  of  period  1  is  put  off  to 
the  following  iteration.  The  tests  in  Section  b  use  the  following  heuristic 
formula: 


-(k) 

t 


,0°/<r<k-,)+1> 


(k)  -Ik) 

The  sire  of  the  reduction  from  i  to  t  is 

<k-l ) 

p  ,  the  lumber  of  additional  periods  lor  which 


price  period  1. 


thus  tied  inversely  to 
n  must  he  computed  to 


Pricing  earliest  or  latest 

The  simplest  possible  ordering  starts  with  the  first  period  and 
runs  forward: 


C  -  1 ,  t 


A  similar  approach  starts  at  the  end  and  works  backwards: 


Ik) 

p,  -  t  +  1  -  (  ,  (  -  1 .  t 

With  simple  pricing,  these  orderings  produce  an  acceptable  candidate 
from  the  earliest  or  latest  possible  period.  They  seem  less  suited  to 
the  other  algorithms,  with  which  they  have  a  more  complicated  behavior. 

Earliest  and  latest  pricing  should  both  tend  to  subopt imice 
heavily  and  consistently.  They  approximate  a  simple,  intuitive  strategy: 
ftrst  optlmixe  the  beginning  (or  end),  then  work  forward  tor  backward). 
Success  of  such  a  strategy  requires  that  the  suboptima  not  be  too  far 
from  a  true  optimum. 
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Trie  tng  t  o_i_  a_  o  d  boa  I  s 

It  was  observed  in  ScctliMi  l  that  staircase  bast's  tend  to  bo 
"well-balanced,"  In  the  sense  that  n  -  m. --the  excess  ot  perlod-t 
columns  over  per lod-<  rows — cannot  bo  very  tar  trow  rero.  t'artial  pricing 
can  encourage  a  balanced  basts  bv  trying  to  bring  co t umns  tnto  the  basts 
In  co  luiun-de  t  to  lent  periods;  tt  sons'  ot  the  outgoing  columns  happen  to 
be  In  column-excessive  periods,  the  overall  balance  of  the  basts  will 
Improve. 

These  Ideas  surest  ordering  the  periods  so  that  the  roost  column- 
deficient  cons'  first,  and  the  roost  column-excessive  a  re  last.  Move 
formally,  such  atx  ordering  satisfies  the  following  relations  iwlth 
n^  being  the  row  and  co l unit  counts  at  Iteration  k': 


Ikl  Ikl  tkl  tkl  ik> 

p  «  P  -*  n  -  m  \  n,  -  tn. 

I  p  p  t  t 


tk>  ik)  ikl  ikl  tkl 

•  p.  **  n  -  «  v  u  -  tn 
t  p  p  l  t 


l  -  l,.. 


I  -  l... 


<  *  V 


t 


t ; 


tki 

<- 


If  several  periods  are  tied  with  the  same  value  ot  ~  m^\  they  can 

be  ordered  among  themselves  In  any  wav;  tt  may  be  wise  to  use  a  cvclle 
ordering  for  this  purpose,  so  that  no  period  Is  undulv  tavorod. 

This  ordering  may  be  used  with  any  ot  the  pricing  algorithms.  In 
all  case*  the  effect  should  he  to  keep  |n^  -  tr^  I  small  In  all  periods. 
As  a  consequence  in ^  -  w^l  should  also  t end  to  be  small;  and  an 

V*  ^ 

Increase  In  square  sub-staircases  fwhere  ; ^  in^  -  -  0)  should  be 

expected.  It  pricing  for  balance  does  encourage  square  sub-staircases, 
it  will  of  course  also  tavor  subopt  imt*«t  ton. 


U 


Another  possible  advantage  ot  a  balanced  basis  arises  when  the 
statrease  bump- and- spike  techniques  ot  i  l , |  are  employed  lor  Uausslan 
elimination.  A  well-balanced  basts  has  relatively  tew  "int erpeviod 
spikes",  and  so  its  l  and  t’  factors  (especially  the  latterl  would  be 
sparser.  Routines  tor  solving  linear  systems  should  operate  tastet  as 
a  result. 

Pricing  to  avoid  subopt_lmi?at  ion 

As  explained  previously,  square  sub-staircases  topper  or  lowei' 
give  rise  to  pricing  barriers;  when  anv  column  is  brought  into  the  basts 
it  is  effectively  subopt tmi ? ing  periods  between  the  nearest  preceding 
lovet  barrier  and  the  nearest  succeeding  tipper  barrier.  It  the  locations 
ot  barriers  can  be  identified,  partial  pricing  may  seek  t o  di scout  age  sub 
optimisation  by  layering  periods  in  the  larger  snbopt imisat ion  intervals. 
IVtails  are  the  same  as  tor  balanced  pricing  above,  except  that  the 
number  ik  -  m(  is  replaced  by  the  number  ot  periods  between  the  pie- 
ceding  lower  and  succeeding  upper  barriers  nearest  to  pel iod  i. 

In  practice  a  basis  mav  have  numerous  st  a  t  tease  forms,  and  it 
seems  a  hopeless  task  tv'  keep  track  ot  the  barriers  in  ever v  one.  It  is 
much  mi' re  reasonable  to  try  to  determine  the  upper  and  l  own  bai  riots  in 
one  staircase  term,  as  dot  ined  in  Section  s;  this  would  require  at  m.'st 
keeping  t rack  ot  the  numbers  ot  linking  and  non-linking  columns  in  each 
period  ot  the  basts,  as  the  numbers  ot  rows  are  fixed.  Storing  this 
information  and  checking  for  barriers  can  be  organised  tairlv  ottlolentlv 
rntortunatelv,  it  pertains  onlv  to  the  staircase  form  that  the  basis 
inherits  from  the  IP;  barriers  in  the  corresponding  reduced-st ait  case 
form  (Section  l l  mav  go  undetected. 
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If  the  coluron-upper-staircase  form  of  the  basis  is  monitored, 
upper  barriers  will  occur  between  the  linking  and  non-linking  columns  of 
the  same  (lower-staircase)  period.  Thus  it  can  be  advantageous  to  con¬ 
sider  the  basis  as  having  2t  -  1  "half-periods":  half-period  2(  -  1 
comprises  the  non-linking  columns  of  period  t,  and  half-period  2t  the 
linking  columns.  Half-periods  are  then  ordered  as  above,  and  any  of  the 
algorithms  may  be  modified  to  price  a  half-period  instead  of  a  period  at 
a  time.  (The  tests  in  Section  6 — which  monitored  lower  and  column-upper 
barriers  only — used  a  scheme  of  this  sort.) 

Barrier  orderings  are  suitable  to  either  simple  or  continuous 
pricing  by  period.  There  is  not  much  point  in  using  these  orderings  with 
repeated  pricing,  which  tends  to  encourage  rather  than  discourage  sub¬ 
opt  imicat ion . 


6.  COMPUTATIONAL  EXPERIENCE 


This  section  reports  on  initial  computational  experiments  will) 
some  of  the  preceding  suggestions  for  partial  pricing  by  period.  Results 
show,  not  surprisingly,  that  partial  pricing  is  considerably  superior  to 
full  pricing  when  reduced  cost  is  the  only  pricing  criterion.  Tests  also 
confirm  that  partial  computation  of  the  price  vector  affords  noticeable 
savings. 

Most  importantly,  in  several  cases  best  results  are  achieved  by 
specialized  staircase  pricing  methods  that  differ  substantially  from  the 
common  general  methods.  Partial  pricing  by  period  thus  appears  to  offer 
savings  not  otherwise  available.  Such  a  conclusion  is  further  borne  out 
by  comparisons  with  the  performance  of  a  standard  commerical  LP  code. 

Experimental  setup 

For  the  test  runs  an  existing  LP  code,  MINOS  [15, 17],  was  modified 
to  recognize  staircase  structure  and  to  apply  staircase  techniques.  Since 
MINOS  employs  a  bump-and-spike  approach  for  sparse  Gaussian  elimination, 
the  staircase  bump-and-spike  technique  [2)  was  added  as  an  option  in  the 
test  version.  Various  optional  pricing  algorithms  were  also  added,  but  in 
such  a  way  that  all  use  the  same  main  loop  for  actually  computing  reduced 
costs.  Timings  for  test  runs  with  different  options  can  thus  be  meaning¬ 
fully  compared. 

The  test  code  is  programmed  in  FORTRAN.  Further  details  of  the 
code  and  the  experimental  setup  are  in  Appendix  B. 

Owing  to  a  limited  (though  large)  computing  budget,  testing  was  con¬ 
fined  to  the  following  seven  methods  of  partial  pricing  by  period: 
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ing  of  periods 

A1 gorithm 

cyclic 

simple 

cycl ic 

con  t Inuous 

cyclic 

repeated 

earl  lest 

simple 

latest 

simple 

balanced 

simple  with 

threshold 

barrier 

simple  with 

thresho Id 

Different  values  of  tolerance  parameter  >  were  first  tested  with  one 
of  the  cyclic  orderings:  the  y  that  gave  best  results  was  then  used  for 
the  other  methods.  The  threshold  parameter  F  was  generally  fixed  at 
1.1;  a  few  tests  at  lower  values  gave  no  better  results. 

Six  medium-scale  linear  programs  of  dissimilar  proportions  were 
employed  in  the  experiments.  Their  overall  dimensions  are  as  follows: 


PERIODS 

ROWS 

COLUMNS 

NONZEROES 

SCARGR25 

25 

472 

500 

2208 

SCRS8 

16 

491 

1169 

4106 

GROW 15 

15 

301 

645 

5666 

SCFXM3 

12 

991 

1371 

8204 

SCTAP2 

10 

1091 

1880 

8645 

SCSD8 

39 

398 

2750 

11349 

All  experiments  measured  the  total  time  and  iterations  to  find  an  optimal 
solution  from  a  feasible  starting  basis;  the  test  code  could  just  as  well 
have  started  from  an  Infeasible  basis,  but  a  feasible  start  was  more 
economical  and  made  the  results  easier  to  interpret.  The  starting  bases 
were  themselves  produced  from  an  all-slack  start,  using  full  pricing  so 
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tlmt  no  method  of  partial  pricing  would  he  favored.  Additional  information 
about  the  test  Id’s  Is  collected  in  Appendix  A. 

In  Interpreting  the  results  It  should  be  kept  In  mind  that  total 
Iterations  are  a  somewhat  stochastic  quantity  that  tarty  vary  by  as  much 
as  10%  when  even  small  changes  are  made.  Proportionally  small  differences 
In  iteration  totals  should  thus  not  be  taken  too  seriously.  Many  tables 
give  both  Iterations  and  seconds  per  100  Iterations,  so  that  It  can  In- 
seen  clearly  how  much  of  any  Improvement  is  due  to  iteration  count  and 
how  much  to  iteration  speed. 

Hun  times  are  also  imprecise,  but  much  less  so.  Times  presented 
here  have  been  rounded  to  avoid  false  precision,  but  all  ratios  and  per¬ 
centages  have  been  calculated  from  the  original  readings. 

Over a  1 1  rosul ts 

As  a  point  of  reference,  the  test  problems  were  first  run  with 
full  greatest-redueed-eost  pricing.  All  were  tried  both  with  and  without 
a  simple  geometric-mean  sealing  (described  In  Appendix  B) :  SCKS8,  CKOWI S 
and  SCTAP2  showed  notably  fewer  Iterations  scaled,  while  S t'At: R2 and 
SCSDH  required  fewer  Iterations  unsealed.  SCKXM3  needed  about  the  same 
numbers  of  Iterations  scaled  and  unsealed,  hut  the  scaled  version  was 
preferred  because  it  had  a  much  smaller  range  of  coefficient  magnitudes. 

Results  of  full  pricing  with  the  preferable  sealings  were  as 


foil  own : 


FULL  PRICING 


SCALED? 

ITERATIONS 

CPU  SEC/ 100  ITER 

TOTAL 
CPU  SEC 

SCAGR25 

NO 

296 

4.8 

14.  1 

SCRS8 

YES 

342 

6.  3 

21.6 

GROWl 5 

YES 

■>72 

3.8 

32.9 

SCFXM3 

YES 

478 

10.3 

SO .  3 

SCTAP2 

YES 

■>40 

10.6 

3  7.2 

SCSD8 

NO 

900 

10.0 

90.0 

In  Informal  tests  scaling  seemed  to  affect  partial  pricing  In  the  same  way 
as  full  pricing,  and  so  the  above  choices  of  scaling  or  no  scaling  were 
kept  throughout  the  tests. 

(experiments  with  the  parameter  >  yielded  the  following  settings: 


SCAGR25  .5 

SCRS8  .2 

GROWl 5  . 2 

SCFXM3  . 2 

SC  TAP  2  .03 

SCSD8  .  3 


As  expected,  a  higher  -y  tended  to  reduce  the  number  of  Iterations  hut 
to  Increase  the  cost  per  Iteration.  SCSl>8  was  an  extreme  case  (wtth  con- 


_Y 

iterat ions 

cpu  sec/100  iter 

total  cjju  sec 

1.0 

906 

7.0 

63. 1 

0.5 

998 

3.9 

38.6 

0.2 

1338 

3.6 

48.4 

In  other  cases  the  choice  of  y  was  not  so  critical.  SCTAl’2  seemed  to 
require  about  the  same  number  of  iterations  (or  any  >  in  the  range 
0.5-0.01,  and  so  its  best  setting  was  smaller  than  the  average. 

The  best  partial-pricing  test  runs — in  terms  of  total  CPU 
seconds — were  as  follows: 


BEST 

RUNS 

CPU  SEC/ 

TOTA1. 

X 

OF  FULL 

ORDER 

METHOD 

ITERATIONS 

100  ITER 

CPU  SEC 

PR1 C1NC 

SCAUR 2 5 

balanced 

simple  w/thr 

333 

3.9 

1  3.0 

9  I  X 

cyclic 

continuous 

348 

3.9 

1  3.5 

941 

SCRS8 

latest 

simple 

272 

4.5 

12.2 

561 

GROW15 

cyclic 

repeated 

508 

3.8 

19.4 

591 

SCFXM3 

cyclic 

repeated 

514 

7.0 

35.9 

711 

SCTAP2 

cycl ic 

cont inuous 

614 

6.4 

39. 1 

681 

cyclic 

s lmple 

642 

6.1 

39.4 

6  91 

SCSD8 

cyclic 

repeated 

996 

3.8 

38. 1 

4  21 

cycl ic 

cont Inuous 

998 

3.9 

38.6 

4  11 

The  diversity  of  best  methods 

is  striking: 

of  the  seven  methods 

tested. 

five  showed  up  as 

best  or  near- 

-best  on  at 

least  one 

problem. 

Si gni f i cant  1 v 

the  one  method  most  similar  to  non-staircase  methods — cyclic  cont tnuous 
pricing — was  never  a  unique  best,  and  was  not  among  the  best  at  all  in 
half  the  cases.  Thus  a  strong  case  is  made  for  staircase  pricing  bv  period 


Four  of  the  six  problems  showed  the  expected  behavior  of  partial 
pricing  versus  full  pricing:  an  Increase  In  number  of  Iterations,  but  a 
compensating  decrease  in  time  per  Iteration.  SCRS8  and  (JROWII,  however, 
show  a  decrease  over  full  pricing  in  both  iterations  and  time  per  itera¬ 
tion,  and  their  total  running  times  are  reduced  dramatically.  The  only 
greater  reduction  is  for  SCSD8,  whose  timings  for  full  pricing  are  inflated 
by  its  huge  number  of  columns. 

The  reduction  of  iterations  for  St'RSb  and  GR0W15  is  accomplished 
in  both  instances  by  pricing  methods  that  tend  to  suboptimize.  It  thus 
appears  that  in  some  cases  suboptimization  is  a  highly  successful  strategy: 
it  simultaneously  shortens  the  iteration  path  and  makes  each  iteration 
cheaper . 

Overall,  partial  pricing  was  decisively  superior  to  full  pricing 
for  all  but  the  smallest  LP,  SCACIR25.  Not  too  much  should  be  made  of  this 
comparison,  however,  since  full  pricing  by  greatest  reduced  cost  Is 
seldom  used  in  practice.  It  is  more  meaningful  to  compare  these  results 
with  non-staircase  partial  pricing,  as  is  done  at  the  end  of  this  section. 

A  comparison  with  steepest-edgo  pricing  (which  is  always  full)  would  also 
be  revealing,  but  unfotunately  MINOS  Is  not  set  up  for  the  required  cal¬ 
culations.  Nevertheless,  it  does  seem  unlikely  that  a  steepest -edge 
criterion  could  reduce  the  number  of  Iterations  for  SCRS8,  GR0W1 or 
SCSD8  sufficiently  to  overcome  the  efficiencies  of  partial  pricing. 

Best  results  aside,  different  methods  varied  considerably  in  how 
close  they  came  to  best  over  the  range  of  problems.  Kach  method  Is  examined 
individually  below.  At  the  end  of  this  section  the  best  times  are 
again  considered,  In  comparisons  with  non-staircase  methods. 
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Simple  cyclic  pricing  by  period  generally  gave  acceptable,  if  not 


impressive,  results: 


SIMPLE  CYCLIC  PRICING 


CPU  SEC/ 

TOTAL 

2  OVER 

ITERATIONS 

100  ITER 

CPU  SEC 

BEST  RUN 

SCAGR25 

415 

3.6 

15.0 

152 

SCRS8 

429 

4.0 

17.2 

422 

GROW 15 

588 

4.8 

28.0 

442 

SCFXM3 

510 

7.6 

38.7 

82 

SCTAP2 

642 

6.1 

39.4 

12 

SCSD8 

969 

4.  3 

41.3 

82 

Here  the  typical 

tradeoff  with 

full  pricing — 

more  iterations,  less  time 

per  iteration — is 

found  in  every  case.  Thus 

worst  result 

s  are  with 

SCRS8  and  GROW15, 

for  which  this  tradeoff  can 

i  be  avoided  by  other  methods 

as  discussed  above. 

Continuous  cyclic  pricing  improved  upon  the  simple  version  in 

every  instance: 

CONTINUOUS  CYCLIC  PRICING 

CPS  SEC/ 

TOTAL 

2  OVER 

ITERATIONS 

100  ITER 

CPU  SJC 

BEST  RUN 

SCAGR25 

348 

3.9 

13.5 

42 

SCRS8 

355 

4.0 

14.  3 

182 

GROW 15 

600 

4.5 

27.2 

402 

SCEXM3 

526 

7.3 

38.3 

72 

SCTAP2 

614 

h.  4 

39.  1 

02 

SCSD8 

998 

3.9 

38.6 

12 

Thus  the  more  sophistciated  stopping  rule  of  continuous  pricing  does  pay 
off.  Continuous  cyclic  pricing  was  most  uniformly  reliable  of  the  methods 
tested,  and  should  be  preferred  when  no  time  is  available  for  testing 
other  methods. 

By  contrast,  the  performance  of  repeated  cyclic  pricing  was 
somewhat  mixed: 


REPEATED  CYCLIC  PRICING 


ITERATIONS 

CPU  SEC/ 

100  ITER 

TOTAL 

CPU  SEC 

1  OVER 
BEST  RUN 

SCAGR25 

396 

3.7 

14.6 

12* 

SCRS8 

375 

4.0 

15.2 

25X 

GR0W15 

508 

3.8 

19.4 

0% 

SCFXM3 

514 

7.0 

35.9 

OX 

SCTAP2 

1115 

6.1 

68.4 

75X 

SCSD8 

996 

3.8 

38.1 

OX 

Repeated  pricing 

is  best  in 

half  the  cases, 

but  significantly  worse 

the  other  half. 

In  the  worst  case,  SCTAP2, 

it  would  be 

a  disaster. 

time  per  iteration  is  consistently  no  greater  than  for  continuous  pricing; 
the  determining  factor  is  number  of  iterations. 

The  behavior  of  repeated  pricing  confirms  what  one  would  expect 
of  a  method  that  tends  to  suboptimise.  When  suboptimization  works  well, 
it  finds  a  short  iteration  path  at  low  cost;  when  it  works  poorly  it 
tends  to  get  stuck  at  suboptimal  solutions  and  the  iteration  path  may 
be  unduly  long. 
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Earliest  and  latest  pricing  by  period 


Signs  of  suboptimisation  are  especially  clear  In  the  results  of 
simple  earliest  and  simple  latest  pricing: 


SIMPLE  EARLIEST  PRICING 


ITERATIONS 

CPU  SEC/ 

100  ITER 

TOTAL 

CPU  SEC 

%  OVER 
BEST  RUN 

SCAGR25 

467 

4.2 

19.5 

50% 

SCRS8 

879 

4.7 

41.6 

242% 

GROW15 

605 

4.4 

26.7 

38% 

SCFXM3 

625 

8.9 

55.3 

54% 

SCTAP2 

>14  79 

(8.0) 

>120.0 

>200% 

SCSD8 

>2000 

(4.0) 

>  79.7 

>100% 

SIMPLE  LATEST 

PRICING 

ITERATIONS 

CPU  SEC/ 

100  ITER 

TOTAL 

CPU  SEC 

%  OVER 
BEST  RUN 

SCAGR25 

391 

3.8 

14.9 

14% 

SCRS8 

2  72 

4.5 

12.2 

0% 

GROW 15 

1387 

4.6 

63.7 

228% 

SCFXM3 

587 

7.7 

45.0 

25% 

SCTAP2 

1200 

7.1 

84.9 

117% 

SCSD8 

>2000 

(5.7) 

>112.9 

>200% 

The  pattern  is  similar  to  that  for  repeated  cyclic  pricing,  hut  more 
pronounced:  huge  variations  in  performance  from  problem  to  problem, 
with  number  of  iterations  the  most  important  factor.  Three  runs  were 
so  hopelessly  long  that  they  were  stopped  prior  to  optimality;  lower 
bounds  on  their  results  are  indicated  by  notations  such  as  " N2000”. 


Curiously,  earliest  pricing  is  much  better  than  latest  on  half 


the  problems,  while  latest  is  much  better  than  earliest  on  the  other 
half.  There  seems  no  obvious  explanation  for  this  dichotomy,  except  to 
say  that  it  is  due  to  the  different  natures  of  the  problems. 

Results  are  probably  also  strongly  influenced  hv  the  choice  of 
starting  basis.  In  the  case  of  SCTAP2,  for  instance,  early  tests  showed 
that  simple  latest  pricing  is  much  superior  to  simple  cyclic  pricing  when 
the  Initial  basis  is  all-slack.  Indeed,  latest  pricing  required  only  1177 
iterations  from  an  all-slack  start,  compared  to  1200  from  the  feasible 
start  above'. 

Clearly  pricing  methods  that  suboptimize  can  give  spectacular 
results.  But  they  are  not  uniformly  effective,  and  only  preliminary  test¬ 
ing  can  determine  whether  they  are  appropriate  to  a  particular  l,P. 

Balanced  pricing  by  period 

The  results  of  simple  balanced  pricing  with  threshold  were  for  the 
most  part  uniformly  mediocre: 


SIMPLE  BALANCED  PRICING  (WITH  THRESHOLD) 


ITERATIONS 

CPU  SEC/ 
100  ITER 

TOTAL 

CPU  SEC 

X  OVER 
BEST  RUN 

SCAGR25 

333 

3.9 

13.0 

OX 

SCRS8 

32  3 

4.7 

15.1 

25% 

GROWl 5 

634 

5.0 

31.5 

62% 

SCFXM3 

729 

7.9 

57.4 

60% 

SCTAP2 

884 

6.5 

57.  7 

48% 

SCSD8 

1173 

4.6 

54.0 

42% 

4b 


Tines  per  itteration  are  generally  worse  than  for  cyclic  pricing; 
apparently  there  are  not  very  many  acceptable  candidates  in  coluran- 
deficient  periods,  and  more  reduced  costs  must  be  computed.  Iteration 
counts  are  also  greater  except  for  SCAGR25  and  SCRS8.  SCAGR25  is  the 
only  clear  success. 

Barrier  pricing  by  period 

Simple  barrier  pricing  with  threshold  was  worse  than  simple 
cyclic  pricing  in  every  instance: 


SIMPLE  BARRIER  PRICING  (WITH  THRESHOLD) 


CPU  SEC/ 

TOTAL 

l  OVER 

ITERATIONS 

100  ITER 

CPU  SEC 

BEST  RUN 

SCAGR25 

442 

4.1 

17.9 

38* 

SCRS8 

386 

4.7 

18.1 

491 

GROW15 

603 

5.1 

30.5 

5  7* 

SCFXM3 

524 

7.9 

41.6 

16X 

SCTAP2 

957 

6.0 

57.8 

48* 

SCSD8 

1231 

4.1 

50.2 

32* 

Better  times  per  iteration  and  fewer  iterations  were  achieved  by  cyclic 
pricing  in  most  cases. 

Possibly  barrier  pricing  employs  too  simple  a  criterion  to  he 
effective.  As  implemented  in  the  tost  code,  it  looks  only  for  square  sub- 
staricases  in  the  lower-staircase  and  column-upper-staircase  forms 
inherited  by  the  basis;  it  may  overlook  other  pricing  barriers.  This 


hypothesis  is  supported  somewhat  by  the  following  table,  which  lists 
average  numbers  of  lower  square  sub-staircases  in  the  reduced-staircase 
form  of  the  basis,  as  reported  by  MINOS 's  basis- factorisation  routine: 


MEAN  LOWER  SQUARE  SUB-STAIRCASES 


CYCLIC  CYCLIC 

FULL  (CONTINUOUS)  (REPEATED)  EARLIEST  LATEST  BALANCED  BARRIER 


SCAGR25 

1.  7 

2.8* 

3.7 

3.6 

3.3 

3.1* 

2.0 

SCRS8 

4.0 

2.1 

1.2 

1.2 

5.2* 

2.9 

2.0 

GR0W15 

9.7 

11.6 

12.0* 

10.9 

9.8 

9.9 

11.1 

SCFXM3 

2.4 

2.8 

2.5* 

3.0 

3.8 

2.7 

2.4 

SCTAP2 

4.9 

3.9* 

2.8 

1.5 

3.3 

2.  2 

1.8 

SCSD8 

2.2 

2.7* 

8.2* 

1.5 

16.4 

8.7 

3.5 

* 

Best  runs 


The  figures  vary  considerably  from  one  pricing  method  to  the  next,  yet  no 


strong  pattern  emerges.  One  may  conclude  that  pricing  strongly  influences 


the  barrier  structure  of  the  basis,  but  in  a  complex  way. 


Partial  computation  of  the  price  vector 

All  of  the  runs  reported  to  this  point  used  a  staircase  "bump-and-spike" 
pivot  order  in  Gaussian  elimination,  and  hence  computed  only  part  of  the 
price  vector  as  described  in  Section  3.  To  determine  the  value  of  this 
arrangement,  six  of  the  best  runs  were  duplicated  twice  with  full  computa¬ 
tion  of  *:  once  using  the  same  staircase  pivot  order,  and  once  with  the 
standard  pivot  order. 
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Although  theoretically  the  pivot  order  and  computation  of  n 
should  have  no  effect  upon  the  iteration  path,  in  practice  small 
numerical  differences  can  result  in  quite  different  paths  and  different 
numbers  of  iterations.  Thus  times  for  the  full-n  runs  below  were  normalized 
to  reflect  the  same  number  of  iterations  as  the  partial-n  run. 

Results  of  these  tests  were  as  follows: 


CPU  SECONDS,  it  COMPUTED  AS  FOLLOWS: 


ORDER 

METHOD 

PARTIAL : 
STAIR  PIV 

FULL: 
STAIR  PIV 

FULL : 

STANDARD  PIV 

SCARG25 

balanced 

simple  w/thr 

13.0 

14.2 

(-  8%) 

13.9 

(-  7%) 

SCRS8 

latest 

simple 

12.2 

13.5 

(-10%) 

13.8 

(-12%) 

CR0W15 

cyclic 

repeated 

19.4 

21.9 

(-11%) 

22.0 

(-12%) 

SCFXM3 

cyclic 

repeated 

35.9 

38.2 

(-  6%) 

38.6 

(-  7%) 

SCTAP2 

cyclic 

continuous 

39.1 

42.7 

(-  8%) 

42.0 

(-  7%) 

SCSD8 

cyclic 

continuous 

38. b 

44.1 

(-12%) 

45.0 

(-16%) 

Partial  computation  of  tt  is  seen  to  offer  a  modest  but  consistent  saving 
of  6-12%.  With  full  computation  of  n  the  staircase  pivot  order  offers 
no  advantage  over  the  standard  order  except  for  SCSD8. 

These  findings  confirm  those  of  [2],  It  is  possible,  as  suggested 
in  [2],  that  other  staircase  pivot-ordering  techniques  may  handle  some 
of  these  LPs  better  than  the  bump-and-spike  technique;  but  the  savings 
through  partial  computation  of  n  should  be  realized  equally  well  with 
any  staircase  ordering. 
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Comparison  with  a  commercial  code 


To  compare  staircase  pricing  to  a  traditional  approach,  the  six 
test  problems  were  also  solved  with  the  WHIZARD  LP  code  of  the  MPS  III 
system  [14]*  WHIZARD  is  a  commercially  marketed  assembly-language  code 
that  should  be  inherently  faster  than  the  FORTRAN  test  version  of 
MINOS.  However,  a  comparison  of  the  iteration  counts  and  timings  should 
give  some  rough  idea  of  the  practicality  of  staircase  pricing  techniques. 

WHIZARD  employs  a  combination  of  partial  and  multiple  pricing 
with  a  maxiraum-reduced-cost  criterion.  Optional  scaling  is  available,  and 
was  used  with  the  four  LPs  that  were  scaled  for  MINOS.  Details  of  the 
WHIZARD  runs  appear  at  the  end  of  Appendix  B. 

The  best  MINOS  runs  for  each  LP  compare  with  the  WHIZARD  runs 
as  follows : 


ITERATIONS 

SEC/ 100 

ITER 

TOTAL 

SEC 

MINOS  VS 

MINOS 

WHIZ 

MINOS 

WHIZ 

MINOS 

WHIZ 

WHIZARD 

SCAGR25 

333 

301 

3.9 

4.1 

13.0 

12.2 

+  n 

SCRS8 

272 

499 

4.5 

3.6 

12.2 

16.1 

-24% 

GROW15 

508 

788 

3.8 

3.3 

19.4 

26.1 

-26% 

SCFXM3 

514 

524 

7.0 

5.5 

35.9 

28.5 

+26% 

SCTAP2 

614 

658 

6.4 

4.5 

39.1 

29.4 

+33% 

SCSD8 

996 

1077 

3.8 

3.7 

38.1 

39.4 

-  3% 

Surprisingly,  MINOS  was  faster  in  half  the  cases  and  significantly  slower 
in  only  two.  This  favorable  showing  can  be  explained  largely  by  the 
advantages  of  staircase  pricing. 


50 


Staircase  pricing  under  MINOS  required  substantially  fewer 

iterations  with  SCRS8,  GR0W15  and  SCSD8,  offsetting  any  disadvantage 

♦ 

in  time  per  iteration.  Hence  MINOS  was  actually  faster  for  these 
problems.  Moreover,  in  the  cases  of  GR0W15  and  SCSD8  the  MINOS  times 
per  iteration  were  not  much  greater  than  the  WHIZARD  times;  it  appears 
that  MINOS  made  up  for  its  inherent  slowness  by  computing  only  part  of  rr 
and  by  pricing  far  fewer  variables  per  iteration.  (It  is  hard  to  say 
anything  more  precise,  however,  since  WHIZARD  does  not  report  the 
number  of  variables  priced.) 

SCAGR25  reversed  the  situation:  it  traded  more  iterations  under 
MINOS  for  slightly  less  time  than  WHIZARD  per  iteration.  On  the  whole 
MINOS  came  out  only  slightly  behind. 

For  SCFXM3  and  SCTAP2  the  numbers  of  iteration  were  comparable 
and  WHIZARD  had  the  expected  edge  in  time  per  iteration.  As  a  result 
MINOS  was  about  30%  slower  overall,  a  respectable  showing  considering 
the  inefficiencies  of  FORTRAN. 

These  results  suggest  that  a  truly  fast  implementation  of  stair¬ 
case  pricing — perhaps  incorporating  machine  language  in  critical  portions 
— would  be  advantageous  in  almost  every  case  and  highly  advantageous  in 
many  cases.  If  the  best  methods  of  [2]  were  also  implemented,  some  stair¬ 
case  LPs  could  well  be  solved  in  a  half  or  even  a  quarter  of  the  time 
currently  taken  by  the  fastest  codes. 


APPENDIX  A:  TEST  PROBLEMS 


The  linear  programs  used  for  the  computational  experiments  of 
Section  6  are  described  in  greater  detail  below.  The  tabular  summaries 
for  each  LP  are  largely  self-explanatory,  but  a  few  general  notes  are 
appropriate : 

All  statistics  except  OBJ  ELEMS  refer  only  to  the  staircase 
constraint  matrix,  excluding  the  objective  row  and  right-hand  side.  In 
each  case  the  constraint  matrix.  A,  has  been  put  in  reduced  standard 


form;  DIAGONAL  BLOCKS  refers  to  the  staircase  blocks  A  ,  and  OFF-DIAGONAL 

U 

BLOCKS  to  the  blocks  A^^  {  . 

Variables  (columns)  are  implicitly  constrained  only  to  be  non¬ 
negative,  unless  there  is  an  indication  to  the  contrary.  BOUNDED  implies 
implicit  lower  and  upper  bounds. 


MAX  ELEM  and  MIN  ELEM  are  the  largest  and  smallest  magnitudes  of 
elements  in  A;  LARGEST  COL  RATIO  is  the  greatest  ratio  of  magnitudes 
of  any  two  elements  in  the  same  column  of  A.  Where  values  are  given 
BEFORE  SCALING  and  AFTER  SCALING,  all  tests  were  conducted  with  A 


scaled  as  described  in  Appendix  B.  Otherwise  NO  SCALING  is  indicated. 
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SCAGR25 


Test  problem  received  from  James  K.  Ho,  Brookhaven  National 
Laboratory,  Upton,  N.Y.;  source  not  documented. 


DIAGONAL  BLOCKS 


PERIOD 

ROWS 

£OLS 

ELEMS 

DENS 

1 

18 

20 

45 

13% 

2-24 

19 

20 

46 

12% 

25 

lb 

20 

43 

13% 

1146 

12% 

OFF-DIAGONAL  BLOCKS  OBJ 


ROWS 

COLS 

ELEMS 

DENS 

ELEMS 

8 

7 

17 

30% 

19 

8 

7 

17 

30% 

19 

19 

408 

30% 

475 

GRAND  TOTALS 
ROWS  471 
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SCFXM3 


Test  problem  received  from  James  K.  Ho,  Brookhaven  National 
Laboratory,  Upton,  N.Y.;  source  not  documented. 
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SCTAP2 


A  dynamic  traffic  assignment  problem,  documented  in  [10].  The 
LP  has  11  objective  rows;  the  one  named  OBJZZZZZ  was  used  in  all  tests, 
and  the  other  ten  were  deleted.  Statistics  below  omit  the  ten  deleted 
objective  rows. 
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SCSD8 


A  multi-stage  structural  design  problem,  documented  in  [8]. 
This  is  the  only  staircase  test  problem  in  which  the  states  do  not 
represent  periods  of  time. 
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APPENDIX  B:  DETAILS  OF  COMPUTATIONAL  TESTS 

Computing  environment 

All  computational  experiments  were  performed  on  the  Triplex 
system  [19]  at  the  Stanford  Linear  Accelerator  Center,  Stanford  University. 
The  Triplex  comprises  three  computers  linked  together:  one  IBM  360/91 
and  two  IBM  370/168s.  Runs  were  submitted  as  batch  jobs  in  a  virtual- 
machine  environment,  under  the  control  of  IBM  systems  0S/VS2,  OS/MVT 
and  ASP. 

Test  runs  employed  a  specially-modified  set  of  linear-programming 
routines  from  the  MINOS  system  [15,17].  MINOS  is  written  in  standard 
FORTRAN.  For  timed  runs,  MINOS  was  compiled  with  the  IBM  FORTRAN  IV 
(H  extended,  enhanced)  compiler,  version  1.1.0,  at  optimization  level  3 
111]. 

Timings 

All  running-time  statistics  are  based  on  "CPU  second"  totals  for 
individual  job  steps  as  reported  by  the  operating  system.  To  promote 
consistency  all  timed  jobs  were  run  on  the  Triplex  computer  designated 
"system  A,"  and  jobs  whose  timings  would  be  compared  were  run  at  about 
the  same  time.  Informal  experiments  showed  roughly  a  IX  variation  in 
timings  due  to  varying  system  loads. 
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MINOS  linear- programming  environment 

MINOS  was  set  up  for  test  runs  according  to  the  defaults  indicated 
in  [15],  with  the  exception  of  the  items  listed  below. 


Scaling.  Problems  noted  as  "scaled"  in  Appendix  A  were  subjected 
to  the  following  geometric-mean  scaling  (where  A  denotes  the  matrix  of 
constraint  coefficients,  not  including  the  objective  or  right-hand  side): 


0. 


1:  Compute  pQ  -  max|Ai  j/A^  j I ,  A^  ^ 

2:  Divide  each  row  i  of  A,  and  its  corresponding  right-hand  side 

1/2 

value,  by  [  (min^  |A^  I )  (max^  I A  I  )  ]  ,  taking  the  minimum 

over  all  A^j  ^  0. 

3:  Divide  each  column  j  of  A,  and  its  corresponding  coefficient 

,1/2 


in  the  objective,  by  [ (min^ [a^  [ ) (uu^ [A^  I)  ] 

taking  the  minimum  over  all  A^  i*  0. 

4:  Compute  p  -  max|A.  ,/A.  , | ,  A.  ,  +  0. 

I2J  l-jJ 


This  procedure  was  repeated  as  many  times  as  possible  until,  at  step  4, 

P  was  at  least  902  of  Pq.  (In  other  words,  scaling  continued  as  long 
as  it  reduced  p,  the  greatest  ratio  of  two  magnitudes  in  the  same  column, 
by  more  than  102.) 


Starting  basis.  A  feasible  starting  basis  was  determined  for 
each  LP  as  follows.  MINOS  was  slightly  modified  so  that  it  would  stop 
and  save  the  first  feasible  basis  obtained;  each  LP  except  GR0W15  was 
run  on  this  modified  version,  from  an  all-slack  start  (crash  option  0) 
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with  full  pricing.  The  saved  feasible  basis  was  used  as  a  starting 
basis  in  all  subsequent  test  runs.  For  GR0W15  an  all-slack  basis  is 
feasible,  and  so  all  test  runs  of  GR0W15  employed  an  all-slack  (crash 
option  0)  start. 

Termination .  Virtually  all  test  runs  terminated  at  an  optimal 
solution.  However,  three  runs — as  indicated  in  Section  6 — were 
terminated  short  of  optimality  because  they  required  too  much  time  or 
too  many  iterations. 

Basis  factorization.  The  staircase  bump-and-spike  factorization 
of  [2]  was  employed  in  all  test  runs  except  as  indicated  otherwise  in 
Section  6. 

Re factorization  frequency.  The  "INVERT  FREQ"  for  MINOS  was  set 
to  50;  hence  MINOS  refactorized  the  basis  (by  performing  a  fresh 
Gaussian  elimination)  every  50  iterations. 

Tolerances.  The  "LU  ROW  TOL"  for  MINOS  was  set  to  10-4.  All 


other  tolerances  were  left  at  their  default  values. 


Modifications  to  MINOS 


All  MINOS  runs  described  in  this  paper  were  made  with  a  special 
test  version  of  MINOS.  This  version  was  essentially  the  same  as  the 
special  test  version  described  in  Appendix  B  of  [2],  except  for  modifi¬ 
cations  to  subroutine  PRICE  to  implement  the  algorithms  of  Section  5. 

Modified  subroutines  that  are  particularly  important  to  pricing 
are  described  briefly  as  follows : 

BTRANL  optionally  computes  only  part  of  the  price  vector  as 
outlined  in  Section  3.  (There  is  no  provision  for  updating  the 
price  vector.) 

SETPI  determines  the  price  vector  back  to  a  specified  period, 
calling  BTRANL  as  necessary. 

PRICE  chooses  a  nonbasic  variable  to  enter  the  basis,  employing 
either  full  pricing  or  one  of  the  partial-pricing  methods  described 
in  Section  5.  Reduced  costs  are  computed  from  the  price  vector 
by  method  (a)  of  Section  2.  SETPI  is  called  one  or  more  times  to 
get  needed  parts  of  the  price  vector. 

SPECS2  determines  which  pricing  method  and  algorithm  will  be  used 
in  a  particular  run,  and  sets  the  parameters  y  and  r,  according 
to  instructions  in  the  SPECS  input  file. 

Other  modifications  are  summarized  in  Appendix  B  of  [2]. 


MPS  III  linear  programming  environment 


For  purposes  of  comparison  all  test  problems  were  also  run  on 
the  MPS  III  system  [14],  as  explained  in  Section  6. 

MPS  III  runs  employed  the  WHIZARD  linear-programing  routines  of 
version  8915  of  MPS  III.  Starting  bases  were  the  same  as  for  the  MINOS 
runs,  and  termination  was  at  an  optimal  solution  in  every  case.  CPU 
timings  reported  in  Section  6  include  both  the  compiler  and  executor  steps. 

The  control  program  for  a  typical  MPS  III  run  was  as  follows: 


PROGRAM 

INITIALZ 

XPROC  -  XPROC  +  6000 
XCLOCKSW-O 
XINVERT-1 
XFREQINV  -  50 
XFREQLG0*1 
XFREQ1-  3000 
MVADR(XDQFREQ1 .TIME) 
M0VE(XDATA, 'SCRS8') 

MOVE (XPBNAME , 'SCRS8' ) 
CONVERT ( ' FILE ' , ' INPUT’ ) 
SETUP (’MIN’ , ’SCALE' ) 

MOVE (X0BJ, ’COST’) 

MOVE (XRHS , ' RHS ' ) 

INSERT( ' FILE ' , ' PUNCH1 ' ) 
WHIZFREQ  DC  (250) 

WHIZSCAL  DC  (4) 

WHIZARD ('SCALE’ .WHIZSCAL) 
TIME  EXIT 
PEND  * 


Control  programs  for  the  other  LPs  were  essentially  the  same.  However, 
the  ’SCALE'  parameter  was  dropped  from  the  SETUP  and  WHIZARD  lines  for 
SCAGR25  and  SCSD8,  since  these  two  LPs  were  unsealed  in  all  of  the 
MINOS  runs. 
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of  algorithms,  ansi  reports  extensive  (although  preliminary! 
computational  experience.  Staircase  computation  algorithms  appear 
to  offer  modest  but  consistent  savings;  staircase  selection  algo¬ 
rithms,  properly  chosen,  may  offer  substantial  savings  in  number 
of  iterations,  time  per  iteration,  or  sometimes  both. 


UNCLASS  If  UO 

MCVMtY  CtAMmCftTiMI  •»  ***» Til 


